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Abstract. We consider computation of permanent of a positive (N X N) non- 
negative matrix, P = (P?\i,j = 1,---,N), or equivalently the problem of 
weighted counting of the perfect matchings over the complete bipartite graph 
Kn N- The problem is known to be of likely exponential complexity. Stated 
as the partition function Z of a graphical model, the problem allows exact 
Loop Calculus representation [Chertkov, Chernyak '06] in terms of an interior 
minimum of the Bethe Free Energy functional over non-integer doubly stochastic 
matrix of marginal beliefs, f} = \i, j = 1, • •• , TV), also correspondent to a fixed 
point of the iterative message-passing algorithm of the Belief Propagation (BP) 
type. Our main result is an explicit expression of the exact partition function 
(permanent) in terms of the matrix of BP marginals, /3, as Z = Pcrm(P) = 

Z SP Pcrm(/3J(l - |8|))/rij jO- ~ Z 3 ; )' wherc Z BP is the BP expression for the 
permanent stated explicitly in terms of /9. We give two derivations of the formula, 
a direct one based on the Bethe Free Energy and an alternative one combining 
the Ihara graph-£ function and the Loop Calculus approaches. Assuming that 
the matrix f} of the Belief Propagation marginals is calculated, we provide two 
lower bounds and one upper-bound to estimate the multiplicative term. Two 
complementary lower bounds are based on the Gurvits-van der Waerden theorem 
and on a relation between the modified permanent and determinant respectively. 



Submitted to: J. Phys. A: Math. Gen. 
1. Introduction 



The problem of calculating the permanent of a non-negative matrix arises in many 
contexts in statistics, data analysis and physics. For example, it is intrinsic to the 
parameter learning of a flow used to follow particles in turbulence and to cross-correlate 
two subsequent images [1]. However, the problem is #P-hard [2], meaning that solving 
it in a time polynomial in the system size, N, is unlikely. Therefore, when size of the 
matrix is sufficiently large, one naturally looks for ways to approximate the permanent. 
A very significant breakthrough was achieved with invention of a so-called Fully- 
Polynomial-Randomized Algorithmic Schemes (FPRAS) for the permanent problem 
[3]: the permanent is approximated in a polynomial time, with high probability and 
within an arbitrarily small relative error. However, the complexity of this FPRAS 
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is 0(N 11 ), making it impractical for the majority of realistic applications. This 
motivates the task of finding a lighter deterministic or probabilistic algorithm capable 
of evaluating the permanent more efficiently. 

This paper continues the thread of [1,4] and [5], where the Belief Propagation 
(BP) algorithm was suggested as an efficient heuristic of good (but not absolute) 
quality to approximate the permanent. The BP family of algorithms, originally 
introduced in the context of error-correction codes [6] and artificial intelligence [7], 
can generally be stated for any graphical model [8]. The exactness of the BP on 
any graph without loops suggests that the algorithm can be an efficient heuristic for 
evaluating the partition function or for finding a Maximum Likelihood (ML) solution 
for the Graphical Model (GM) defined on sparse graphs. However, in the general 
loopy cases one would normally not expect BP to work well, thus making the heuristic 
results of [1, 4, 5] somehow surprising, even though not completely unexpected in view 
of existence of polynomially efficient algorithms for the ML version of the problem 
[9, 10], also realized in [11] via an iterative BP algorithm. This raises the questions of 
understanding the performance of BP: what it does well and what it misses? It also 
motivates the challenge of improving the BP heuristics. 

An approach potentially capable of handling the question and the challenge was 
recently suggested in the general framework of GM. The Loop Series/ Calculus (LS) 
of [12, 13] expresses the ratio between the Partition Function (PF) of a binary GM 
and its BP estimate in terms of a finite series, in which each term is associated with 
the so-called generalized loop (a subgraph with all vertices of degree larger than one) 
of the graph. Each term in the series, as well as the BP estimate of the partition 
function, is expressed in terms of a doubly stochastic matrix of marginal probabilities, 
P = (J3f\i,j = l,---,iV), for matching pairs to contribute a perfect matching. This 
matrix /3 describes a minimum of the so-called Bethe free energy, and it can also 
be understood as a fixed point of an iterative BP algorithm. The first term in the 
resulting LS is equal to one. Accounting for all the loop-corrections, one recovers the 
exact expression for the PF. In other words, the LS holds the key to understanding 
the gap between the approximate BP estimate for the PF and the exact result. In 
section 2 and section 4, we will give a technical introduction to the variational Bethe 
Free Energy (BFE) formulation of BP and a brief overview of the LS approach for the 
permanent problem respectively. 

Our results. In this paper, we develop an LS-based approach to describe the 
quality of the BP approximation for the permanent of a non-negative matrix, (i) Our 
natural starting point is the analysis of the BP solution itself conducted in section 3. 
Evaluating the permanent of the non-negative matrix, P = {{p J i ) 1 ^ T \i, j — 1, • • • , N), 
dependent on the temperature parameter, T £ [0, oo], we find that a non-integer BP 
solution is observed only at T > T c , where T c is defined by (15). (ii) At T > T c , we 
derive an alternative representation for the LS in section 5. The entire LS is collapsed 
to a product of two terms: the first term is an easy-to-calculate function of /3, and 
the second term is the permanent of the matrix, /?. * (1 — /3) = (/3,-(l — Pj))- (The 
binary operator .* denotes the element-wise multiplication of matrices.) This is our 
main result stated in theorem 3, and the majority of the consecutive statements of 
our paper follows from it. We also present yet another, alternative, derivation of the 
theorem 3 using the multivariate Ihara-Bass formula for the graph zeta-function in 
subsection 5.2. (iii) Section 6 presents two easy-to-calculate lower bounds for the LS. 
The lower bound stated in the corollary 7 is based on the Gurvits-van der Wacrdcn 
theorem applied to Perm(/3. * (1 — /?)). Interestingly enough this lower bound is 
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invariant with respect to the BP transformation, i.e. it is exactly equivalent to the 
lower bound derived via application of the van der Wacrdcn-Gurvits theorem to the 
original permanent. Another lower bound is stated in theorem 8. Note, that as follows 
from an example discussed in the text, the two lower bounds are complementary: the 
latter is stronger at sufficiently small temperatures, while the former dominates the 
large T region, (iv) Section 7 discusses an upper bound on the transformed permanent 
based on the application of the Godzil-Gutman formula and the Hadamard inequality. 
Possible future extensions of the approach arc discussed in section 8. 



2. Background (I): Graphical Models, Bethe Free energy and Belief 
Propagation. 

Permanent of a non-negative matrix, P = {{jp{) 1 ^ T \i, j = 1,- • • ,N) (0 < p\, < T < 
oo), is a sum over the set of permutations on {1, . . . , N}, which can be parameterized 
via binary-component vectors, ct, corresponding to perfect matchings (PM) on the 
complete bipartite graph Kn,n: 



N N 



This binary interpretation allows us to represent the permanent as the partition 
function (PF), Z, of a probabilistic model over the set of perfect matchings. Each 
perfect matching, a, is realized with the probability 

n°) = \p°\ p°= n ^'r- /T ,^E^ /T=Perm ( p )' ( 2 ) 

where E = i,j = 1,...,N} is the edges of Kn.n- In the zero-temperature 

limit, T — > 0, (2) selects one special ML solution, cr* = argmax (T P' :r . (Here and 
below we assume that P is non-degenerate, in the sense that at T — > 0, J > (cr) — > for 
Vcr^ a*.) 

For a generic GM, assigning (un-normalized) weight P® to a state a, one 
defines exact variational (called Gibbs, in statistical physics, and Kullback-Leibler 
in statistics) functional 

?{b(a)}^Tj2Hv)^ b -j^- (3) 

a 

One finds that under condition that the belief, b(a), understood as a proxy to the 
probability T(cr), is normalized to unity, ^2 aePM b(a) = 1, the Gibbs functional is 
convex and it achieves its only minimum at b(o~) = y{cr) and S^J 1 } = —T\nZ. 

BP method offers an approximation which is exact when the underlying GM is 
a tree. As shown in [8], the BP approach can also be stated for a general GM as 
a relaxation of the Gibbs functional (3). In this paragraph wc briefly review the 
concept of [8] with application to the permanent problem. For the GM (2), the BP 
approximation for the state beliefs becomes 

,,,,,, um^u^^) 

6(a) w b BP (a) = — J , (4) 

n (iJ)e £^(^) 

where Vi, j: a t = (a{ e {0, = 1, • • • ,N) s.t. £\ of = 1 and a J ' = (of G {0, l}\i = 
1, • • ■ , N) s.t. Y^,i a \ — 1: i- e - a i an d cr-? each has only N allowed states corresponding 
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to allowed local perfect matchings for the vertices i and j respectively. The vertex 
and edge beliefs are related to each other according to 

V(*,j) e E : 4(4) = Wn) = E & V)' (5) 

and the beliefs, as probabilities, should also satisfy the normalization conditions: 

V(i,j)€E: 6J'(1) + 6?'(0) = 1. (6) 

Note, that our notations for beliefs are not identical to ones used in [8]: the multi- 
variable beliefs, hi, are associated with vertexes of Kn^n, and the single-variable 
beliefs, are associated with edges of the graph. Substituting (4) into (3) and 
approximating YlvePM H a )f( a i ) w ^h J2a j H( a i)f( a i) e ^ c i one arrives at the BFE 
functional 

*BP{til(°iy, fcfo); &V')} ^E-TS, E^Y, l0 S(^)' ( ? ) 

s = E E 6 * W) ln6 'K) -EE w ln6 ^) -EE &V') k&V')- (8) 

Note that the BFE functional is bounded from below and generally non-convex, 
and thus finding the absolute minimum of the BFE is the main task of the BFE 
approximation. The BP approximation Zbp of the partition function is given by 
J bp = —TItlZbp at a minimum of the BFE. 

Moreover, the variational formulation of (5,6,7,8) can be significantly simplified 
in our case; one can utilize (5,6) and express 6i((Ti),6 J (cr J ) and frf (of ) solely in terms 
of the (3j = bl(l) variables, satisfying doubly-stochastic constraints 

V(*,j)€£:0<#'<1; Vi:E# =1 ; v, : E % ' • (9) 
The entropy (8) becomes 

sim = E (pi L °g >• + o- - #) mi - #')) - £ E # lo s# - £ £ # l °g % 

= E((l-^)Ml-/3D-^ln^). (10) 

Therefore, the Bethe-Free energy approach applied to the GM (2) results in 
minimization of the following Bethe-Free Energy (BFE) functional 

?bp{(3}=T E (^'ln-H--(l-^)Ml-^)) ) (11) 

over (3 = (f3f) under the constraints (9). 

To analyze the minima of the BFE, we incorporate Lagrange multipliers \Xi^n? 
enforcing the constraints in (9). Looking for a stationary point of the Lagrange 
function over the /3 variables, one arrives at the following set of quadratic equations 
for each (of N 2 ) variables, (3f 

V(i,j)&E; ^(l-/3f) = (^') 1 / T exp(/i i + ^). (12) 

One observes that any solution of (9,12) at T > 0, that contains at least one f3f which 
is not integer, does not contain any integers among all /3f. In fact, our main focus 
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Figure 1. This figure contains a set of illustrations based on the homogeneous 
example 1 discussed in the text. N = 10 and W = 2 are chosen for these 
illustrations. Figure lb shows TlnZ for the homogeneous model (red) and 
respective BP expression, TlnZ bp (blue) as functions of the temperature, T. 
Green dash line mark T c . figure lc shows comparison of different estimations of 
ln(Perm(/3. * (1 — /?))/ Ylu — Pi)) vs the temperature parameter T, where /3 
is the matrix of marginal beliefs evaluated at a fixed point of BP equations. Red, 
Blue, Purple, Green and Dashcd-Gray lines show the exact expression, the lower 
bound of the corollary 7, the lower bound of the theorem 8, the upper bound of 
the proposition 9 and the BP expression, respectively. 




(a) 3 B p vs e. (b) TlnZ vs T. (c) \n{Z/Z BP ) vs T for differ- 

ent estimators. 



will be on these non-integer (interior) solutions of (9,12). To find a solution of BP 
(9,12) one relies on an iterative procedure. For a description of a set of iterative BP 
algorithms convergent to a minimum of the BFE for the perfect matching problem we 
refer the interested reader to [1, 4, 5]. 

Remark 1 Note that just derived BP approximation differs from the so-called Mean- 
Field (MF) approximation corresponding to the following ansatz 

b(a)^b MF (a)= J] VM), (13) 

enforcing statistical independence of the edge beliefs. If one substitutes b(a) by &m_f(c) 
in (3) and also accounts for the normalization condition (6), which may be understood 
here as one enforcing the "Fermi exclusion principle" for an edge to contribute a 
perfect matching, aj = 1, the resulting expression for the MF free energy will turn into 
BP expression (11) with the first term there changing sign to — . One expects that BP 
approximation outperforms MF approximation in accuracy. Consider, for example, 
N = 10 and f3{ = l/N, then the exact, BP and MF entropies are ln(10!) w 15.10, 
100(.91n(.9) - .lln(.l)) w 13.54 and 100(-.9 ln(.9) - .lln(.l)) « 32.50, respectively. 
An intuitive explanation for MF overestimating the entropy term is related to the fact 
that MF ignores correlations related to competitions between neighboring edges for 
contributing a perfect matching. 

3. Threshold Behavior of BP at Low Temperatures 

As discovered in [11], at T = 0, properly scheduled iterative version of BP converges 
efficiently to the ML solution of the problem. In this context it is natural to ask the 
question of how a non-integer solution of BP emerges with a temperature increase. To 
address this question, we first consider the following homogeneous example. 
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Example 1 Define a homogeneous weight model biased toward a perfect matching 
solution, a\ — 6f : p\ = 1 if i ^ j and p\ = W (W > 1). Looking for j3 in the 
homogeneous form 

| e :othcrwise, 

one observes that this ansatz for j3 solves the BP (9,12) at e equal to e TO j„ = 
(N — 1 — W^ T )/((N - l) 2 - W 1 / T ). At T = oo, the probabilities are uniform, 
i.e. (3 from (14) with e = e m in is (3f = 1/N for all G -E. Now consider lowering 
the temperature and observe that at T c = In W/ ln(iV — 1) the nontrivial solution, with 
f3f 7^ 0, 1 for all (i,j) G E, turns exactly into the isolated/trivial ML one, fi\ = 8{. 
Obviously one finds that the BFE, IbF: considered as a function of e, achieves its 
minimum at e = t m i n if T > T c . Exactly at T = T c this e m in = and the nontrivial 
solution merges into the isolated ML solution. The dependence of the BFE on e for 
different T (at some exemplary values of N and W) is shown in figure la. The partition 
function can be calculated efficiently. Counting the configurations straightforwardly 
(in a brute force combinatorial manner), one derives Z = Efclo W^ N ~ k ^ T (f^)Dk- 
The following recursion is used to evaluate the number of permutations coefficient, 
D k : V k > 2, D k = (k - 1) (£>*_! + D k - 2 ), D = 1, D± = 0. A comparison of 
ThiZ and TItiZbp as functions of T is shown in figure lb. 

Returning to the case of an arbitrary nonnegative P, we discover that this 
phenomenon of the nontrivial solution splitting at some finite nonzero (!!) temperature 
from the ML configuration is generic. 

Proposition 1 For any non-negative matrix P = ((p^ ) 1 ' T \i,j = 1,* • • , N) one finds 
a special (we call it critical) temperature, T c , such that for T > T c + e a nontrivial 
solution of BP, corresponding to a local non-saturated minimum of J bp, dominating 
the respective value corresponding to the maximum likelihood solution, is realized for 
at least a sufficiently small positive e. This special solution coincides with the best 
perfect matching solution at T = T c and it does not exist for T < T c . The critical 
temperature T c solves 

det(P/ - 2aJ i P() = 0, (15) 

where cr* is the ML configuration. 

Proof: Our proof of the proposition is constructive. Let us look for a solution of 
the BP equations weakly deviating from the ML configuration cr*. Without loss 
of generality we assume that crj = 8{. We introduce vj = /3j(l — /3|) <C 1 
and observe that a nontrivial solution, approaching the ML one at v 0, is 
& = (1 — (1 — 2<5^)[1 — 4w^] 1 / 2 )/2. Linearizing the normalization condition, over 
v one derives, Vi : v\ = ^2j^i v l ] Vj : v 3 rj = Yli^j v l On tnc other hand, the 
BP equation (12), complemented by the set of linear constraints on v, translates 
into, Vi : /'//'' = E^i-P/^'; Vj : P]U, = V,. , /•;'/ ,. where I , = exp(^) 
and U 3 = exp(^ J ). Requiring that the later equations have a nontrivial solution 
(with nonzero v), one arrives at the critical temperature condition, (15). It is then 
straightforward to verify that the extension of the nontrivial solution into the T < T c 
domain is unphysical (as some elements of the respective small v solution are negative), 
while the BFE associated with the nontrivial solution for T > T c is smaller than the 
one corresponding to the ML perfect matching. 
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Conjecture 2 We conjecture that the non-integer solution of BP equations discussed 
in proposition 1 extends beyond the small T c + e vicinity of T c , and this solution 
transitions smoothly at T — > oo into the obvious fully homogeneous solution, fi\ ~ 1 /N 
for all (i,j) G E. Another plausible conjecture is that no other non-integer solutions 
exist at T < T c ; therefore when the non-integer solution discussed in the proposition 
emerges at T = T c it, in fact, gives a global minimum of the BFE. 

4. Background (II): Loop Calculus and Series 

Here we consider T > T c where, according to the main result of the previous section, 
there exists a solution of (9,12) lying in the interior of the doubly-stochastic-matrix 
polytopc. We assume that such a nontrivial solution of the BP equations is found. 

As shown in [12, 13], the exact partition function of a generic GM can be expressed 
in terms of a LS, where each term is computed explicitly using the BP solution. 
Adapting this general result to the permanent, bulky yet straightforward algebra leads 
to the following exact expression for the partition function Z from (2): 

Z/Z BP = z LS ; z LS = 1+ ^2 r c, 

rc-fna-^fiK 1 -^)) n t^j- 

VeC / \jec / (i,i)ec 1 p * 

The variables /3 are in accordance with (9,12) and C stands for an arbitrary generalized 
loop, defined as a subgraph of the complete bipartite graph with all its vertices having 
a degree larger than 1. The qi (or g- 7 ) in (16) arc the C-dcpcndent degrees, i.e. 
q t = J2j\(i. 3 )ec^ an d Q j = J2i\(i.j)ec ^- According to (16), those loops with an 
even/odd number of vertices give positive/negative contributions rc- 

5. Loop Series as a Permanent 

This section, explaining the main result of the paper, is split in two parts. In subsection 
5.1 we give a simple derivation of a very compact representation for the LS (16) 
following directly from the BFE formulation. Subsection 5.2 contains an alternative 
derivation of this main formula from LS using the concept of the Ihara-Bass graph 
(■-function [14, 15]. 

We also find it appropriate here to make the following general remark. Even 
though discussion of the manuscript is limited to permanents, counting perfect 
matchings over K^^, all the results reported in this section allows straightforward 
generalizations to weighted counting of perfect matchings over arbitrary (and not 
necessarily bipartite) graphs. 

5.1. Permanent representation for Z/Zbp 

Theorem 3 For any non-integer solution of the BP equations, (9,12), the following 
is true: 

Perm(P)/Z B p = Perm(/3. * (1 - 0)) J] (1 — ySf") -1 , (17) 
where A. * B is the element-by- element multiplication of the A and B matrices. 
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Proof: From the definition of the BFE, 3^bp = —TIuZbp, and (9,12) one derives 

= n (i-$)ii e " ,ii n e 

(i,j')eE i J 

On the other hand (12) results in, Perm(P) = Pcrm(/J. * (1 - /3)) 
Y\i exp(— /.ij) J}^ exp(— /i-'). Combining the two formulas we arrive at (17). 

Remark 2 Note that if one considers expanding the permanent on the rhs of (17) 
over the elements of the matrix /3. * (1 — /3), each element of the expansion will be 
positive, in the contrast with the LS of (16). Moreover, the number of terms in the 
Perm-expansion is significantly smaller than in the original LS. 

5.2. From LS to the permanent representations for Z/Zbp 

Here we discuss the relation between the two complementary representations of 
Z/Zbp, i.e. between the LS expression (16) and the permanent formula (17). We 
do this in two steps, stated in the two theorems presented consequently, one relating 
the LS to an average of a determinant, and another one expressing it via the permanent 
of/3. *(l-/3). 

Theorem 4 (LS as Average of Determinant) Let E be the set of directed edges 
obtained by duplicating undirected edges E of K^^. Define the edge-adjacency matrix 
M of the complete bipartite graph Kn,n according to M^j^^i = #i,i(l — $j,k)- 
Let x = r^fi^g be the set of random variables that satisfies (x^j) = 0, 

{xi^jXj-^i) = 1 and {xi^,jXk^i) = ({i,j} =/= {&,/}). (Here and below (■ ■ -) x stands 
for the mathematical expectation over the random variables x.) Then the following 

relation holds: z^s — (det[7 — iHM]) x , where 23 = diag(^/ /Sf/(1 — Pi) x i^j)- 
Proof: For a general undirected graph G, the Ihara-Bass formula [14, 15] states that 
Cg 1 ^) = det[/-uM] = (1 -u) |BHy| det[/ + u 2 CD - L) -uA], (18) 

where A is the adjacency matrix and 23 = diag^ji £ V) is the degree matrix of 
G. If we take the limit u — > oo, this formula implies detM = (— 1)I B IL<ev(1 — 
Expanding the determinant, one derives 

n 

det[J-iSM]= J2 dctM l{ ei ,..,e„}H) fc n( S )^- ( 19 ) 

{ei,...,e„}CE 1=1 

Evaluating the expectation of each summand in (19), one observes that it is nonzero 
only if (i —> j) G {ex, ■ ■ ■ , e„} implies (j — > i) € {ex, • ■ • , e„}, thus arriving at 

(det[I-iSM]) x = ^(-l) |c| dctM| c ^j = l+ rc - 

CCE {i,j)eC 1 _ Pi %^CCE 

Theorem 5 (From LS to Permanent) For the doubly stochastic matrix of BP 
beliefs, [3, and LS defined in (16), one derives 

z iS = Perm(/3.*(l-/3)) (l-^*)" 1 - 

(»,j)eE 



Zbp = I 



(i.i)eE 



id) 1/T \* 
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Proof: We use theorem 4, choosing the random variables x\ — x^j = Xj^i that 
take ±1 values with probability 1/2. We also utilize a multivariate version of the 
Ihara-Bass formula from [16] to derive the following expression for zj,s proving the 
theorem 



det[J-£BM] =det 







{^p.*{l-P).*x) T 



n (i-fr 1 - 



z LS = (det(V/?-*(l-/3)- * xf)x II C 1 = Perm ^- * - II (! 

6. Invar iance of the Gurvits-van der Waerden lower bound and new 
Lower Bounds for the Permanent 

Van der Waerden [17] conjectured that the minimum of the permanent over the doubly 
stochastic matrices is N /N\, and it is only attained when all entries of the matrix 
are l/N. Though the conjecture appears to be simple, it remained open for over fifty 
years before Falikman [18] and Egorychev [19] finally proved it. Recently Gurvits [20] 
found an alternative, surprisingly short and elegant proof, that also allowed a number 
of unexpected extensions of the Van der Waerden conjecture. We call it the Gurvits- 
van der Waerden theorem. (See e.g. [21].) A simplified form of this theorem is as 
follows. 

Theorem 6 (Gurvits-van der Waerden theorem [20,21]) For an arbitrary non- 
negative N x N matrix A, 

Perm(A) > cap^)— — , where p A {x) = TT V" a ld Xj, ca,p(p A ) = inf — . 

We have found that the lower bound of the theorem 6 has a "good" property 
with respect to the BP transformation. As stated in theorem 3, BP transforms the 
permanent to another permanent. Therefore, applying theorem 6 to both sides of (17), 
one naturally asks how do the two lower bounds compare? A somewhat surprising 
result is that the Gurvits-van der Waerden theorem is invariant with respect to the 
BP transformation. Namely, cap(pp) = Zbp * cap(p^ ^)) Yi(i j)£E^ ~ The 
lower bound for Perm(/3. * (1 — (3)) based on the theorem 6 is 

Corollary 7 Pcrm(/3. * (1 - /?)) > ^ ]J (1 - ft/* 

Proof: This bound is the result of a direct application of the inequality, ■ ft\ (1 — 

P\ 



•■*;')•'•, -II, (l-fflxj 



, to theorem 6. 



We also obtain another lower bound which improves the bound of corollary 7 at 
sufficiently low values of the temperature. See figure lc for an illustration. 

Theorem 8 For an arbitrary perfect matching II (permutation of {1, ... , N} ), 
Perm(/?. * (1 - /?)) > 2]J^(1 - /5f «) 



Belief propagation and loop calculus for the permanent of a non-negative matrix 10 



Proof: Without loss of generality, we assume that II is the identity permutation. 
From the positivity of entries and (9), we have Perm(/3. * (1 — /?)) > FT. /3*Perm(A"), 
where Xy = Sij + (1 — 2Si j)f3f. Since /3 is a stochastic matrix, dctX = 0, and thus 
Perm(X)> 2^(1-$). 

Note, for the sake of completeness, that a comprehensive review of other bounds on 
permanents of specialized matrices (for example 0, 1 matrices) can be found in [22]. 

7. New Upper Bound for Permanent 

Proposition 9 Perm(/3. * (1 - /?)) < JJ(1 - J^(^ ) 2 ). 

3 i 

Proof: We use the Godzil-Gutman representation for permanents [23] 

Perm(/3. * (1 - p)) = (dct(V£. * (1 - 0). * <jf) a , (20) 
where af = ±1, with i,j = 1, ...,N are independent random variables taking values 
±1 equal probability. Each row of the matrix ^Jf3. * (1 — /3).*a has the squared Euclid 
norm /3f (1 — /3|) = 1 — Y^iifil) 2 - Therefore, the upper bound is obtained from the 
Hadamard inequality, | det(ai, . . . , a n )\ <|[ ffli || • • • || a n \\. 

8. Path Forward 

We consider this study to be the beginning of further research along the following 
lines: (1) More detailed analysis of the BP solution. In particular, study of T c , e.g. 
concerning its dependence on the matrix size; analysis of the BP solution dependence 
on temperature; and the construction of an iterative algorithm provably convergent to 
a nontrivial BP solution for T > T c . (2) Explanation of the BP invariance with respect 
to the Gurvits-van der Warden lower bound. (3) Development of a deterministic 
and/or randomized polynomial algorithm for estimating the permanent with provable 
guarantees based on the loop calculus expression. (4) Numerical tests of the lower and 
upper bounds for realistic large scale problems. 
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